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ABSTRACT 


GOES  infrared  (IR)  data  is  intercon^aied  with  rain  analyses  from  the  SSM/I 
expraiential  rain  algorithm  for  the  purpose  of  determining  thresholds  and  statistics  from 
IR  imagery  which  delineate  oceanic  rain  area.  Data  from  ERICA  cyclogenesis  cases 
were  evaluated. 

Discriminant  analysis  was  performed  using  IR  mean  cloud  top  temperature, 
standard  deviaticm  and  kurtosis  as  discriminating  variables.  Resulting  functions  separated 
rain  from  no-rain  areas  with  average  Probability  of  Detection  (POD)  and  Percentage 
Error  (ERR)  scores  of  0.68  and  0.30  for  develt^ment  data  (0.62  and  0.37  for  validation 
data).  The  scheme  demonstrated  little  skill  in  discriminating  rain  categories  beyond 
rainMo-rain. 

An  IR  threshold  scheme  was  used  to  delineate  rainMo-rain  areas  by  optimizing  a 
set  of  evaluation  statistics.  Optimal  diresholds  attained  a  predetermined  POD  level  of 
0.60  while  minimizing  percent  misclassificatitm  errOT  and  SSM/I-IR  rain  area  difference. 
The  scheme  yielded  average  POD  and  ERR  scmres  of  0.64  and  0.38  with  IR  thresholds 
from  229  to  232  K. 

Results  for  both  the  discriminant  analysis  and  optinud  thre^old  schemes  compare 
favorably  with  previous  studies.  The  use  of  the  SSMA  rain  analyses  with  geostatirmary 
imagery  allows  reliable,  frequent,  large  scale  analysis  of  oceanic  precipitation. 
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I.  INTRODUCTION 


The  determinaticm  of  rainfall  over  extensive  areas  is  important,  not  only  for  long 
range  climatological  studies,  but  also  for  real-tin^  operational  purposes.  Satellite  data 
imagery  allows  vast  areas  to  be  studied,  areas  with  previously  limited  or  non-existent 
observadtms.  Of  particular  interest  to  naval  operations  is  the  determination  of 
precipitation  areas  in  oceanic  regions. 

While  geostati(xiary  visual  (VIS)  and  infrared  (IR)  satellite  coverage  of  oceanic 
areas  has  been  available  since  1974,  its  use  for  precipitation  analysis  has  been  limited 
since  VIS  and  IR  data  sense  cloud  properties,  not  precipitation  directly.  However,  the 
recent  development  of  precipitation  algorithms  utilizing  satellite  microwave  data  from 
the  operational  Special  Sensor  Microwave/Imager  (SSM/I)  yields  direct  oceanic 
precipitation  information  available  every  12  h  from  current  and  future  Defense 
Meteorological  Satellite  Program  (DMSP)  polar  orbitting  satellites. 

The  objective  of  this  thesis  is  to  intercompare  IR  data  from  the  Geostaticmary 
Operational  Environmental  Satellite  (GOES)  widi  DMSP  SSM/I  precipitation  analyses. 
The  intercomparison  should  allow  the  determinaticm  of  IR  thresholds  and  statistics  which 
delineate  the  rain  area.  These  thresholds  can  be  used  for  subsequent  hourly  rain 
analyses  until  microwave  verification  data  is  again  available,  six  or  12  h  later.  GOES 
and  SSM/I  data  are  currently  used  by  the  Navy,  and  a  precipitaticxi  delineation  scheme 
utilizing  these  data  types  could  readily  be  incorporated  into  an  operatiotuil  product. 


1 


IR  and  microwave  data  from  the  Experiment  on  Rapidly  Intensifying  Cyclones 
over  the  Atlantic  (ERICA)  will  be  used  in  this  thesis.  ERICA  was  conducted  from 
01  December  1988  to  28  Febraaiy  1989  over  the  northwest  North  Atlantic  Ocean. 
Centering  on  the  climatologically  favored  area  for  rapid  cyclogenesis,  it  spanned  an  area 
from  SON  to  SON,  80W  to  SOW.  The  objectives  of  ERICA  (Hadlock  and  Kreitzberg 
1988)  were  to:  (1)  understand  the  fundamental  i^ysical  processes  occurring  in  the 
atmosphere  during  rapid  intensificadcxi  of  cycltmes  at  sea,  (2)  determine  those  physical 
processes  that  need  to  be  incorporated  into  dynamical  prediction  models  through 
efficient  parameterizations,  and  (3)  identify  measurable  precursors  that  must  be 
incorporated  into  the  initial  analysis  for  accurate  and  detailed  operational  model 
predictions.  ERICA  data  includes  eight  Intensive  Observational  Periods  (lOP’s)  of  36 
to  48  h  duration.  Each  lOP  covers  the  development  of  a  rapid  cyclogenesis  event, 
defined  as  an  exttattopical  surface  cylone  whose  central  pressure  fall  averages  at  least 
one  mb/h  for  24  h.  ERICA  measurements  were  made  from  aircraft,  buoys,  satellites, 
soundings  and  radar.  This  variety  of  data  makes  ERICA  storms  an  ideal  test  bed  for 
oceanic  ptecq>itation  aiuilysis. 

Specific  objectives  of  diis  thesis  are: 

1.  Investigate  differences  in  IR  btighmess  ten^ratute  (Tg)  values  between  SSM/I- 
determined  raining  and  odier  non-raining  clouds  such  as  dense  cirrus. 

2.  By  optimizing  selected  statistical  parameters,  determine  an  IR  T^  threshold  which 
delineates  ptecq>itation  as  determined  by  SSM/I  data. 
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A  literature  review  of  precqiitation  analysis  methods  using  various  combinaticais 
of  VIS,  IR  ,  radar  and  microwave  data  is  presented  in  Ch^ter  H.  Ch85)ter  III  details 
how  the  ERICA  IR  and  SSM/I  data  used  in  this  analysis  was  obtained  and  prepared. 
The  initial  analysis  of  localized  areas  within  tlw  ERICA  storms  is  presented  in  Chapter 
rv,  followed  by  a  discriminant  analysis  t^proach  to  precipitation  delineation  in  Chiq)ter 
V.  Chapter  VI  explores  an  IR  thresholding  scheme  for  precipitation  analysis.  A 
summary  with  conclusicms  and  recommendaticHis  for  future  research  and  in^lementation 
of  these  schemes  is  presented  in  Quqrter  VII. 
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n.  SATELLITE  PRECIPITATION  ESTIMATION  TECHNIQUES 


A.  VISUAL  AND  INFRARED  METHODS 

1.  VIS  and  IR  Overview 

The  estimation  of  rain  with  VIS  and  IR  data  is  subjective,  as  piec^itadon 
is  not  sensed  directly.  Rather,  VIS  and  IR  yield  information  about  cloud  thickness  and 
cloud  top  tenq)erature,  respectively.  Cloud  type  is  inferred  from  diese  values,  and  rain 
area  and  rate  further  inferred  from  the  cloud  type.  Four  basic  methods  ate  currently 
used  to  delineate  rain  areas  with  VIS  and  IR  (Barrett  and  Martin  1981): 

1.  Qoud  Indexing 

2.  Qoud  Life  History 

3.  Qoud  Model 

4.  Bispectral 

Qoud  Indexing  is  the  oldest  method,  and  it  is  based  on  identifying  the  cloud  types. 
A  standardised  rain  rate  is  then  qtplied  to  eadi  cloud  type.  Widi  Qoud  Life  History, 
rain  rate  is  a  function  of  die  stage  in  the  cloud's  life  cycle.  (3riifith  et  al.  (1978)  derived 
a  diagnostic  method  to  estimate  rainfall  using  this  mediod.  Stout  et  al.  (1979)  also 
employed  the  Qoud  Life  History  method.  They  examined  the  relation^iqi  between 
radar-estimated  rain  rate  and  satellite-measured  cloud  area,  focusing  on  the  concept  that 
piec4)itation  peaks  while  the  cloud  area  is  n^idly  growing.  The  Life  History  method 
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is  a  valuable  research  tool,  but  is  not  adequate  for  real-time  application  as  it  requires 
tracking  a  cloud  throu^  its  develq)ment  before  assigning  a  rain  rate.  Cloud  Models 
are  being  developed  which  incorporate  cloud  physics  knowledge  into  the  retrieval 
process.  These  can  use  combinaticms  of  the  other  three  methods,  but  are  currently  in 
developmental  stages  and  not  available  for  q)erational  use. 

2.  Bispectral  Method 

Bispectral  methods  interconqiare  VIS  and  IR  data,  where  high  VIS  values 
indicate  thick,  bright  clouds  and  hi^  IR  values  indicate  cold  cloud  top  temperatures 
(Kidder  and  Vonder  Haar,  1991).  The  first  application  of  a  bispectral  method  was 
conducted  by  Reynolds  and  Vonder  Haar  (1976),  where  cloud  heights  and  amounts  were 
determined  using  simultaneous  VIS  and  IR  satellite  data.  (^  a  two  axis  (VIS  and  IR) 
plot,  stratus  clouds  iq)pear  as  bri^t  and  warm,  while  convective  rain  clouds  are 
clustered  in  the  cold,  bright  region.  Threshold  values  for  both  axes  can  be  determined 
to  differentiate  cloud  types.  Bispectral  methods,  because  of  their  ease  and  consistently 
good  results,  are  quite  suitable  for  real-time  c^rational  use. 

A  bivariate  frequency  distribution  to  differentiate  raining^rm-raining  clouds  was 
developed  by  Lovejoy  and  Austin  (1979a).  Their  use  of  radar  observations  to  train  a 
technique  to  recognize  prec4>itati<mg  clouds  is  termed  the  RAINSAT  approach.  Pixels 
were  assigned  to  either  "Rain"  or  "No  Rain"  VIS/IR  histograms,  based  on  Canadian 
ground  and  shipboard  radar  data.  The  plots  were  combined  to  yield  a  bispectral  (VIS/IR) 
fivquency  plot  of  precipitation  probabilities  (rain  pixelsAotal  pixels)  for  each  VIS/IR 
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value  combination.  Figure  1  illustrates  this  plot,  with  the  resulting  optimum 
precipitation  boundary.  This  boundary  is  similar  to  a  threshold,  but  is  not  limited  to 
values  parallel  to  the  axes,  and  therefore  allows  greater  flexibility.  Rain  maps  for 
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PRECIR  PROBABILITY  (7.) 


Fig.  1  Precipitation  probabilities  derived  from  rain/no-Rain  histograms.  The 
boundary  separates  raining  from  non-raining  pixels  based  on  an  optimum 
probability.  (Lovejoy  and  Austin  1979) 


6 


1 

i 


geographical  areas  were  then  ccHistructed  by  applying  the  VIS  and  IR  values  specified 
by  the  optimal  boundary  and  minimizing  a  misclassification  error  function.  The  authors 
found  that  while  VIS  data  gave  more  information  than  IR,  IR  data  was  useful  in 
ccxivective  cloud  studies.  A  bispectral  method  was  determined  more  accurate  than  a 
single  channel  method.  Another  finding  was  that  actual  rain  area  was  approximately  1/4 
the  size  of  the  cloud  cover. 

Lovejoy  and  Austin  (1979b)  investigated  the  sources  of  error  in  bispectral  rain 
estimation,  determining  the  amount  of  error  due  to  errors  in  rain  area  determination 
versus  error  in  rain  rate  algorithms.  From  the  magnitudes  of  error  found,  they 
ccxicluded  that  current  VIS  and  IR  schemes  were  good  for  determining  rain  areas,  but 
not  rain  rates. 

Tscmis  and  Isaac  (1985)  used  a  two  part  method  to  determine  rain  area  firom 
VIS  and  IR  satellite  data.  The  first  part  was  to  differentiate  raining  from  non-raining 
clouds  using  a  cluster  analysis.  Results  of  a  bivariate  fiequency  distributitxi  were 
plotted  <xi  a  scatter  diagram,  and  divided  into  three  clusters.  Ouster  1  ccHisists  of  points 
associated  with  clear  skies  and  nmuaining  clouds,  while  Ouster  2  consists  of  points 
corresponding  to  nonraining  low-level  overcast,  fog  and  haze.  Ouster  3  consists  of 
points  assigned  mainly  to  raining  clouds,  but  includes  some  cirrus.  Decision  boundaries 
to  separate  the  clusters  were  drawn  by  intersecting  a  point  equidistant  firom  the  three 
cluster  centers.  Results  are  illustrated  in  Figure  2. 
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A  llAlnlnt  Clouds 


Fig.  2  Decisim  boundaries  separate  clusters  of  VIS  and  IR  frequency  peaks. 
(Tsonis  and  Isaac  1985) 


The  second  part  of  Tstmis  and  Isaac’s  method  was  to  determine  a  specific  VIS 
threshold  which  would  delineate  the  rain  area  from  Cluster  3.  Using  land-based  radar 
as  ground  truth,  a  VIS  threshold  was  establisted  which  gave  a  satellite/radar  rain  area 
near  unity.  The  authors  outlined  two  evaluation  parameters: 
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1.  Probability  of  Detection:  POD  =  (satellite  correctly  classified  rain  area)  /  (radar 
rain  area) 

2.  False  Alarm  Ratio:  FAR  =  (satellite  incorrectly  classified  rain  area)  /  (satellite 
rain  area) 

Their  VIS  threshold  yielded  a  POD  of  0.66  and  an  FAR  of  0.37.  Tsonis  and  Isaac 
crxicluded  that  while  most  of  the  rain  area  informatirxi  was  derived  fit)m  VIS  data,  for 
cases  of  strcxig  crmvectirxi,  a  single  IR  threshold  could  accurately  delineate  rain  area. 
The  authors’  method  gave  best  results  for  convective,  versus  stratiform,  cases. 

Tsonis  (1988)  evaluated  a  simpler  rain  area  delineation  approach  which  used  a 
single  VIS  or  IR  threshold.  Con^ared  to  more  complicated  schemes,  this  single 
threshold  approach  performed  quite  adequately.  Optimal  thresholds  yielded  POD  and 
FAR  scores  of  0.62  and  0.38  (VIS  thre^old)  and  0.60  and  0.40  (IR  threshold). 
Tsonis  concludes  that  the  sinq>licity  and  accuracy  yielded  by  a  single  threshold 
technique  may  make  it  useful  for  delineating  prec^itation  area  on  large  scales. 

Negri  and  Adler  (1987a)  used  a  "Grid  Oil”  q>proach  to  estimate  rain  from  VIS 
and  IR  data.  Focusing  subtropical  convective  systems,  their  iq^roach  e3q>lored  the 
relationship  between  cloudy  grid  cells  (determimd  by  VIS/IR  threshold  values)  and  the 
variability  of  die  precqiitation  within.  Unlike  the  methods  of  Lovejqy  and  Austin  or 
Tsonis  and  Isaac,  IR,  versus  VIS,  parameters  were  used  to  eiqilain  most  of  the 
variability.  The  authors  found  that  while  hi^  rainrates  required  low  cloud  top 
temperatures,  these  low  cloud  top  tenqieratures  did  not  necessarily  yield  high  rainrates. 
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The  auth<»5  concluded  that  that  cm  the  scales  used,  useful  and  accurate  estimates  beyond 
rainMo-rain  discrimination  were  unlikely. 

Negri  and  Adler  (1987b)  describes  a  "Qoud  Definition"  {q)pFoach  to  precq>itation 
delinearicm,  where  cloud  area  was  defined  by  an  IR  threshold.  The  authors  sought  to 
maximize  a  Critical  Success  Index  (CSI),  incorporating  POD  and  FAR  (Appendix  A). 
They  found  a  good  ccmrelaticm  between  IR-determined  cloud  area  and  rain  area,  but 
limited  usefulness  of  VIS  data. 

Results  of  the  "Grid  Cell"  and  "Qoud  Definition"  ^roaches  were  used  to 
formulate  the  Convective-Stratiform  Technique  (CST)  by  Adler  and  Negri  (1988).  This 
method  defines  convective  cores  by  their  IR  tenqmrature  minima  and  stnmg  temperature 
gradient.  Rainrate  and  rain  area  are  assigned  to  the  cores  as  a  function  of  IR  cloud  tq> 
tenqierature.  A  strarifonn  rain  algoridun,  based  on  die  mode  tenqierature  of 
thunderstorm  anvils,  conqiletes  the  convective/stratifonn  rain  estimation. 

While  Negri  and  Adler  focused  on  IR  values  to  determine  precqiitation  in  the 
subtropics.  King  (1990)  evaluated  the  relative  impmtance  of  VIS  and  IR  data  in 
determining  midlatitude  rainrates.  Using  the  Lovejoy  and  Austin  (1979a)  RAINS  AT 
iqiproach.  King  compared  VIS  and  IR  GOES  data  widi  coincident  radar  rainrate  data. 
He  concluded  that  both  rainrate  and  fiactirmal  rain  volume  showed  a  strcmger 
relationshq)  with  VIS  count  than  with  IR  count.  King’s  results  enabled  the  construction 
of  probability  of  rain  and  rainrate  contours  based  on  bispectral  VIS  and  IR  data. 
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Fmther  e}q>anding  on  the  bispectral  concept,  Neu  (1990)  evaluated  an  automated 
multispectral  (AVHRR  VIS,  IR,  and  IR  split-window)  nephanalysis  model,  with  the  goal 
of  cloud  type  classification  cm  a  multispectral  axis.  He  verified  the  automated  results 
with  a  subjective  cloud  analysis  consensus,  and  was  able  to  successfully  distinguish  1 1 
cloud  types.  His  strongest  results  were  in  determining  precipitation  clouds,  showing  diat 
multi)^)ectral  analysis  could  yield  fast,  accurate  results  in  cloud  type  determinatirai. 

These  studies  show  that  precipitatim  areas  can  be  delineated  using  VIS 
and/or  IR  satellite  data.  Such  data  is  readily  available  from  geostatiraiary  satellites, 
yielding  craitinuous,  real-time  coverage  of  extensive  global  areas.  The  methods 
described  generally  utilized  surface-based  radar  as  ground  truth,  and  focused  on  areas 
close  to  land. 

B.  MICROWAVE 

Like  radar,  microwave  remote  sensing  is  a  method  of  directly  sensing  precipitation, 
either  through  absoiption/emissirai  or  scattering  of  radiation  by  precipitation.  Unlike  the 
surface-based  radar  used  in  the  previous  studies,  however,  satellite-based  microwave 
sensors  give  global  coverage  from  a  platfram  similar  to  satellite  VIS  and  IR  sensors. 

Figure  3  depicts  the  nrailinear  relationshq)  of  bri^tness  temperature  (Tg)  to  rainrate 
over  ocean  and  land  backgrounds  for  three  microwave  frequencies  (Kidder  and  Vonder 
Haar  1990).  Tg  -  rainrate  relationships  have  been  used  by  several  authors,  including 
Wilheit  and  Chang  (1980)  and  Spencer  et  al.  (1989),  to  estimate  rainrate. 
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Fig.  3  Brightness  temperatures  versus  rainrates  for  3  microwave  frequencies. 

(Kidder  and  Vonder  Haar  1990) 

Cataldo  (1990)  evaluated  several  mU''owave  rain  algorithms,  determining  that  the 
initial  SSM/I  Hughes  Aircraft  Company  (HAC)  algorithm  was  inadequate  for 
determining  rain  rates.  He  found  that  using  from  the  horizontally  polarized  37  GHz 
channel  (37H)  yielded  the  best  rainrate  results.  37H  uses  an  absorption  regime,  is 
sensitive  to  low  rainrates  and  has  little  noise  interference.  For  the  37H  channel,  Cataldo 
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used  a  threshold  temperature  of  190  K  as  a  rain/no-rain  cutoff,  with  increasingly  warmer 
temperatures  to  255  K  for  heavier  rainrates.  Using  coastal  radar  and  ship  reports  as 
ground  truth,  he  ccaicluded  that  satellite-based  microwave  data  could  successfully 
delineate  oceanic  rain  areas,  and  could  further  define  rainrates. 

Almario  (1991)  examined  a  more  recently  developed  exponential  rain  algorithm 
which  incoiporates  data  from  multple  SSM/I  channels  (Olson  et  al.,  1991).  Conparing 
the  SSM/I  results  with  aircraft  and  ground-based  radar  observations  for  several  ERICA 
storms,  Almario  found  that  the  exponential  algorithm  produced  successful  results  in 
detecting  oceanic  rainAio  rain  areas  and  rain  intensity.  Results  using  the  exponential 
algorithm  were  found  to  be  far  stperior  to  those  found  using  either  the  HAC  algorithm 
or  37H  channel.  Conpaiisons  with  GOES  IR  imagery  revealed  that  most  of  the  cold 
cloud  top  (heavy  convection)  regions  coincided  with  maximum  rainrates  in  the  SSM/I 
analyses. 

There  are  several  potoitial  error  sources  inherent  in  microwave  rainfall 
determination.  First,  microwave  resolution  is  poor.  The  resolution  for  the  37  GHz 
channel  is  32  km  -  significantly  less  than  for  VIS  and  IR  channels.  The  large  footprint 
characteristic  of  microwave  radiometers  introduces  a  problem  with  beam-filling  and 
ncHilinearity.  The  radiometer  averages  the  Tg  over  diis  large  fooprint.  However,  this 
average  does  not  necessarily  yield  a  representative  mean  rainrate  because  of  the 
nonlinearity  of  Tg  in  rainrate.  This  beam-filling  problem  generally  results  in  an 
underestimation  of  the  mean  rainrate  within  the  footprint. 
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Notable  success  has  been  (Stained  using  improved  microwave  rain  algorithms  to 
delineate  rain  areas  and  rainrates.  With  microwave  data,  accurate  rain  analyses  can  be 
attained  at  12  h  intervals  over  large  land  and  ocean  areas.  Thus  far,  surface  radar  has 
been  used  as  ground  truth  for  the  developimnt  of  VIS  and  IR  precq>itation  analysis 
schemes.  With  coverage  far  exceeding  that  of  surface  radar,  SSM/I  rain  analyses  are 
logical  candidates  to  use  as  ground  truth  for  oceanic  studies.  This  utilizaticm  should 
significantly  in^iove  piec^itation  analysis  over  oceanic  areas,  \^ere  conventional 
verification  data  is  notably  sparse. 
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m.  DATA 


The  choice  of  data  to  be  analyzed  was  based  primarily  on  the  availability  of 
coincident  digital  GOES  IR  and  DMSP  SSM/I  images  which  covered  well-developed 
ERICA  storms.  Because  of  the  time  of  day  and  ctxisequent  sun  angle,  there  was  no 
adequate  GOES  VIS  imageiy  for  the  time  periods  examined.  Table  I  sununarizes  the 
data  sets  used  in  this  analysis,  referred  to  as  Cases  A,  B,  and  C;  all  times  are  Universal 
Coordinate  Time.  Synoptic  descriptions  of  each  case  foUow  in  Chapter  IV. 


Tabkl  ERICA  STORMS  STUDIED 


Date 

Time  of  Image  (UTC) 

Case 

lOP 

GOES 

SSMA 

A 

2 

13  Dec  88 

0901 

0903 

B 

2 

13  Dec  88 

2301 

2257 

C 

4 

4  Jan  89 

2101 

2147 

A.  m  IMAGERY 

IR  (10.5-12.5  pm)  imageiy  is  obtained  from  the  Visible  and  Infrared  Spin  Scan 
Radiometer  (VISSR)  flown  aboard  the  GOES-East  satellite.  The  spatial  resolutitxi  for 
each  pixel  at  nadir  is  8  x  4  km  (8  km  resolution  north-south  and  4  km  east-west),  where 
the  4  km  resolution  is  obtained  by  oversan^Iing  in  the  east-west  directicm.  IR  imageiy 
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is  displayed  on  the  NFS  IDEA  Lab  as  512  x  512  pixel  images.  The  intensity  range  of 
die  IR  pixels  is  0  -  255  counts.  Values  of  IR  count  are  easily  converted  to  equivalent 
briefness  tenqieratuies  (Tb)  using  a  standard  IR  calibration  table  (Ensor  1978). 

B.  SSM/I  IMAGERY 

SSM/I  data  are  obtained  from  the  polar  orbiting  DMSP  satellite.  Vertically  and 
horizontally  polarized  19,  35  and  85  GHZ  data  channels  are  available  on  the  SSM/I 
senscv,  almig  widi  a  vertically  polarized  22  GHz  channel  Resolution  is  prqxntional  to 
die  channel’s  frequency,  and  ranges  frmn  13  km  for  die  85  GHz  channel  to  50  km  for 
the  19  GHz  diannel  Brightness  temperatures  from  these  seven  channels  (referred  to  as 
19V,  19H,  22V,  37V,  37H,  85V  and  85H)  are  incorporated  into  the  expmiential  rain  rate 
algorithm  and  screening  logic  developed  by  Olson  et  al  (1991).  The  algoridim  used  is 
specific  for  oceanic  rainfall,  and  its  accuracy  when  applied  to  ERICA  storms  was 
e;q)l<Hed  and  verified  by  Almaiio  (1991).  Both  Okon  (1991)  and  Almaiio  (1991)  found 
that  the  rainrates  derived  from  die  SSM/I  exponential  algoridim  coneqxmded  well  widi 
radar-derived  rainrates,  and  were  superior  to  rainrates  derived  from  previous  algorithms. 
However,  validaticn  of  the  eiqionential  algorithm  has  thus  far  been  qualitative,  and  no 
accuracy  figures  have  yet  been  established.  The  results  of  the  eiqponential  algorithm  are 
displayed  in  a  512  x  512  pixel  image  as  rainrates  from  0  to  25  mm/h.  Because  of  the 
multidiannel  incoiporation,  resolution  of  the  image  is  reduced  to  the  coarsest  of  the 
seven  channels,  50  km. 
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C.  IMAGE  RECTIFICATION 

IR  and  SSM/I  images  were  originally  displayed  in  their  natural  coordinate  systems 
for  processing  ccmvenience.  However,  in  order  to  compare  the  two  image  types,  they 
must  be  displayed  using  die  same  projection.  Image  rectification,  also  known  as  "real 
world  image  nuqiping,"  is  a  solution  to  this  problem  (Bernstein,  1983).  IR  and  SSM/I 
images  for  each  case  were  rectified  to  a  common  Cylindrical  Equidistant  (CED) 
projecticHi.  Images  were  navigated,  and  latitudes/longitudes  were  specified  so  that  the 
IR  image  covered  the  same  geognqihic  area  as  the  coiresp<xiding  SSM/I  image.  Images 
could  then  be  interconqiaied,  pixel  by  pixeL  A  landmasJdng  routine  was  also  qipUed 
to  enable  easy  discrimination  between  land  and  ocean  areas  whoi  searching  the  data 
pixels. 

The  area  represented  by  each  rectified  pixel  is  dependent  cm  die  size  of  the 
geogr^hic  area  specified  For  Cases  A  and  B,  each  pixel  represents  approximately  4.5 
X  4.5  km,  while  Case  C  pixels  cover  about  6x6  km.  Actual  image  resoludcxi,  however, 
is  unchanged  from  the  original  data,  and  remains  at  8  x  4  km  for  IR  and  50  x  50  km 
for  SSM/I  images.  Because  of  the  discrete  sanqiling  performed  in  the  image  rectification 
prcxress,  giqis  can  occur  v4ien  high  resolution  (IR)  images  are  renuqiped.  These  gaps  are 
filled  using  a  pixel  interpolation  method.  For  low  resolution  images  (SSM/I),  only  cxie 
image  pixel  is  used  for  each  screen  pixel,  and  no  interpolation  is  required 
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Rectified  IR  and  SSM/I  images  constitute  the  data  base  for  the  analyses  to  be 
perfonned  in  this  study.  Navigaticxi  and  remapping  to  equivalent  projectitm  allows  pixel 
by  pixel  inteiC(Hiq>aiis(xi  fin:  the  precipitation  analyses  described  in  the  following 
chapters. 
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IV.  LOCALIZED  RAIN/NO-RAIN  STUDIES  OF  ERICA  lOP  2  AND  4 

Selected  areas  of  cold  GOES  IR  ten^rature,  determined  by  SSM/l  analysis  to  be 
eidier  raining  or  ntHiraining,  were  examined  to  deternaine  if  any  informatitm  existed 
within  the  IR  data  that  could  successfully  discriminate  rain  from  no-rain/cimis  for  Cases 
A,  B,  and  C  (Table  1). 

The  SSM/I  e^qKxiential  rainrate  algorithm  was  applied  to  each  case,  yielding  a 
display  of  rain  area  and  rainrates.  This  display  was  used  as  ground  truth  in  choosing  20 
X  20  pixel  areas,  (referred  to  as  "cloud  boxes")  from  the  GOES  IR  imagery.  The  cloud 
boxes  were  positioned  so  that  the  rainrates  within  each  box  were  as  homogeneous  as 
possible.  A  representative  collection  of  no  rain  (cirrus),  U^t  (1-2  mm/h),  moderate  (2-4 
mm/h),  and  heavy  (>4  mm/h)  rain  areas  was  selected.  GRAFSTAT  statistical  analysis 
software  (Buikland  et  al.  1990)  was  used  to  evaluate  die  20  x  io  pixel  IR  data  arrays. 
A  histogram  and  set  of  san^le  statistics  were  generated  for  each  cloud  box  to  investigate 
cloud  top  ten^rature  differences  between  the  rain  and  no-rain  areas. 

A.  CASE  A:  13/0901  DECEMBER  1988 

Case  A  (jOES  and  SSM/I  imagery  (Figures  4  and  5)  describes  the  first  of  two 
storm  systems  during  lOP  2.  The  first  upper-air  trough  moved  offshore  of  the  Georgia  - 
South  Carolina  coast  shortly  after  13A)000.  A  surface  cyclone  developed  with  this 
system,  dMpened  modestly  for  die  initial  12  h  period  and  moved  eastward  alrnig  SON. 
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By  the  tune  of  this  SSM/I  pass,  the  cycltuie  had  developed  into  a  coninuna-shaped 
cloud.  Its  1004  mb  stoim  center  is  centered  near  33N  68W.  (Harmett  et  al.  1989) 

The  SSM/I  e^qxmential  rain  algorithm  analysis  results  are  given  by  Figure  4,  with 
rainrates  coded  by  mm/h.  Heaviest  prec4)itation  (IS  mm/h)  lies  east  of  the  cyclone 
center,  and  is  surrounded  by  relatively  concentric  areas  of  decreasing  rainrate.  A  band 
of  moderate  and  heavy  rainfall  extends  east  of  die  system  center  associated  widi  die 
warm  firont,  while  a  second  band  (cold  front)  extends  southwest  to  the  Bahama  Islands. 
Figure  5  presents  the  concurrent  GOES  IR  imagery.  While  die  GOES  IR  overall  cloud 
area  and  shape  coincide  with  the  SSM/I-detmnined  rain  area,  cirrus  is  evident  nordi  of 
die  primary  rain  area.  The  cloud  boxes  analyzed  are  indicated,  and  labeled  as  ”C" 
(citrus)  or  "R"  (rain).  The  locations  of  the  boxes  were  chosen  to  study  cloud  top 
tenqieratuies  between  the  citrus  area  and  die  raining  area  to  the  soudi. 

An  analysis  of  the  resulting  sample  statistics  (Table  11)  and  distribution  histograms 
(Hgure  6)  fev  die  cloud  boxes  reveals  clear  differences  between  die  rain  and  no>rain 
samples.  The  no-rain  (dzrus)  samples  resenible  eadi  other  closely,  bodi  in  their 
distribution  shqie  and  in  die  IR  mean  (18S.39)  (232.5  K)  and  standard  deviation  (2.97). 
The  rain  samples  are  characterized  by  a  higher  mean  IR  count  (197.71),  colder  cloud  top 
temperature  (220.8  K)  and  genetalfy  lower  standard  deviati(XL  Rain  sauries,  however, 
are  not  homogeneous,  but  ippear  to  vary  according  to  rainrate.  Samples  R1  and  R2 
represent  li^t  and  moderate  rainrates,  and  exhibit  high  mean  (203.17)  (214.8  K)  and 
low  standard  deviatiem  (1.07)  values.  Hiese  are  in  sharp  contrast  with  the  lower  mean 
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Table  n  CASE  A  SAMPLE  STATISTICS 


Box 

Rainrate 

Mean 

StdJJev. 

Kurtosis 

Cl 

0 

185.43 

2.35 

2.38 

C2 

0 

183.15 

3.54 

4.42 

C3 

0 

184.61 

1.75 

2.90 

C4 

0 

188.37 

4.22 

5.12 

Mean  C 

185.39 

2.97 

3.71 

R1 

Lt/Mod 

203.34 

1.12 

3.08 

R2 

U 

203.01 

1.02 

4.91 

R3 

Hvy 

188.00 

12.18 

2.06 

R4 

Hvy 

192.27 

4.34 

2.15 

R5 

Hvy 

201.92 

1.17 

3.86 

Mean  R 

197.71 

3.97 

3.21 

(194.06)  (223.9  K)  and  higher  standard  deviation  (5.89)  values  C(»ieq>onding  to  the  hi^ 
rainrate  san^les  R3,  R4  and  R5. 

Analysis  of  color-enhanced  IR  cloud  top  temperatures  (not  shown)  reveals  that 
cloud  boxes  with  light  and  moderate  rainra^  (R1  and  R2)  coincide  with  areas  of 
unifonn  cloud  top  temperatures,  as  suggested  by  the  low  standard  Aviation  values. 
While  RS  is  categorized  as  heavy  rain,  the  SSM/I  imagery  shows  that  the  area  contains 
several  rainrate  levels  ranging  from  5  to  11  xnm/h,  and  appears  to  be  a  transitim  area 
from  moderate  to  heavy  convective  rain  areas.  Ihis  may  explain  why  the  statistics  for 
R5  more  closely  resemble  those  of  the  lightMioderate  rain  boxes  than  of  the  heaviest 
rain  boxes.  Qoud  boxes  R4  and  R5  are  represented  in  tte  enhanced  GOES  imagery  as 
areas  of  significant  cloud  top  temperature  variability,  with  strong  cloud  top  temperature 
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Fig.  6  Case  A  Distribution  Histograms  for  analyzed  cirrus  and  rain  areas 


gradients.  Such  a  cloud  tq)  temperature  pattern  is  consistent  with  the  towering  cumulus 
(and  con^nsating  descent  areas)  associated  with  heavy  ccmvective  rain.  Kurtosis 
values  were  evaluated,  but  appear  to  have  no  discernible  pattern  in  differentiating 
rainMo-rain  areas. 

It  is  q>parent  from  the  analysis  that  mean  IR  count  and  standard  deviation  can  be 
used  to  differentiate  rain  from  no-rain  areas  for  this  case.  Notable  points  are  the 
Gaussian  distribution  of  cirrus  IR  values  and  the  variations  of  rain  IR  values  with 
rainrate. 

B.  CASES:  13/2301  DECEMBER  1988 

Case  B  satellite  imagery  (Figures  7  and  8)  depict  the  secrxid  storm  system  in  lOP 
2.  This  second,  stronger  upper>air  trou^  with  associated  upper-level  jet  streak  moved 
offshore  from  Virginia  and  Nordi  Carolina  at  about  13/12(X).  A  surface  trough 
developed  northward  from  the  Gulf  Stream  off  Capt  Hatteras  towards  Ixmg  Island  and 
southern  New  England.  Central  pressure  of  the  system  at  13/2300  was  q>proximately 
995  mb,  with  rq)id  intensification  to  occur  during  the  next  12  h.  (Harmett  et  al.  1989) 

Cirrus  and  rain  cloud  boxes  were  chosen  on  the  basis  of  concurrent  SSM/I 
precipitation  analysis  (Figure  7),  and  are  labeled  m  the  GOES  IR  imagery  (Figure  8). 
While  SSM/1  rain  area  is  within  the  cmifines  of  the  GOES  high  cloud  area,  extensive 
cirrus  cover  is  apparent  bodi  east  and  north  of  the  system  center,  probably  blown  off 
from  the  storm  center  by  the  upper-level  jet.  Again,  cloud  boxes  were  chosen  to  study 
cloud  top  temperature  differences  between  the  downstream  cirrus  and  rain  areas. 
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Fig.  7  As  in  Fig.  4,  except  Case  B:  13/2257  December  1988. 
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The  heaviest  rain  area  (11-13  nun/h)  is  centered  at  37N  71W.  Also  seen  on  this 
imagery  is  a  trailing  frontal  band  from  the  storm  system  analyzed  in  Case  A. 


Table  m  CASE  B  SAMPLE  STATISTICS 


Box 

Rainrate 

Mean 

StdDev. 

Kurtosis 

Cl 

0 

188.54 

3.34 

3.43 

C2 

0 

194.65 

1.84 

3.52 

C3 

0 

191.76 

6.58 

10.06 

C4 

0 

191.50 

2.53 

2.74 

Mean  C 

191.61 

3.57 

4.93 

R1 

U 

196.10 

0.88 

2.48 

R2 

Lt 

186.64 

5.41 

3.31 

R3 

Lt/Mod 

182.34 

3.73 

3.06 

R4 

Hvy 

195.43 

2.02 

2.35 

R5 

Hvy 

186.15 

3.51 

2.01 

Mean  R 

189.33 

3.11 

2.64 

Saiiq>le  statistics  for  Case  B  are  presented  by  Table  m  aiui  distribution  histograms 
by  Hgure  9.  In  contrast  to  die  results  in  Case  A^  no  large  temperature  differences  are 
apparent  between  the  cirrus  and  rain  boxes  for  diis  case.  In  fact,  the  mean  for  cimis 
cloud  boxes  is  slightly  colder  (191.61)  (226.4  K)  dian  die  mean  for  rain  boxes  (189.33) 
(228.7  K).  The  imagery  constraints  allowed  cmly  analysis  of  cirrus  boxes  from  the 
northeastern  quadrant  of  Case  B’s  cyclone  system,  \«1iereas  citrus  boxes  from  the 
northwest  quadrant  of  Case  A’s  system  were  analyzed. 
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Figure  9  shows  that,  like  Case  A,  the  cirrus  boxes  have  a  more  Gaussian  distribution 
than  the  rain  boxes.  However,  a  wide  range  of  standard  deviaticm  and  kurtosis  values 
is  present  for  both  groups.  This  case  illustrates  the  large  differences  that  can  exist  for 
different  cases. 

C.  CASEC:  4/2101JANUARY  1989 

Case  C  satellite  imagery  (Figures  10  and  11)  illustrates  prec^itatirm  and  cloud 
structure  of  the  lOP  4  cycltme,  the  deepest  extratiopical  cyclcme  of  the  experiment 
(Hartnett  et  al.  1989).  The  system  first  speared  as  several  low  centers  off  the  North 
Carolina  coast,  then  deepened  into  a  powerful,  single  center  cyclorre  wlwn  a  strong 
upper-air  disturbance  reached  the  coastline  at  about  4/0000.  Rapid  intensification 
occurred  between  4/0900  and  4/1500,  with  an  estimated  deepening  rate  of  24  mb/6  h. 
The  cyclone  continued  to  develop  as  it  moved  nordieast  towards  Newfoundland.  At  die 
tuiK  of  Case  C  imagery,  the  cyclone  is  centered  at  39N  S9W,  with  a  central  pressure 
of  950  mb.  This  case  differs  from  the  others  in  that  the  system  is  mature,  vice  inc^ient, 
with  pronounced  frontal  structure  at  the  time  of  the  imagery. 

The  4/2101  GOES  IR  imagery  (Figure  11)  includes  the  labeled  cirrus  and  rain 
cloud  boxes  to  be  statistically  analyzed.  Again,  these  boxes  were  chosen  (xi  the  basis  of 
SSM/I  determined  rainAio-rain  areas  (Figure  10).  The  4/2147  SSM/I  imagery  for  this 
case  was  not  concurrent  with  GOES,  but  differs  by  46  min.  Hie  time  difference  is  not 
considered  significant  for  this  analysis  because  the  size  and  locatim  of  die  cloud  boxes, 
well  buffered  by  surrounding  areas  of  similar  SSM/I  and  IR  values,  more  than  accounts 
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Fig.  10  As  in  Fig.  4,  except  Case  C:  4/2147  January  1989. 
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Fig.  11  As  in  Fig.  5,  except  Case  C:  4/2101  January  1989. 
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for  any  movement  or  development  of  the  cyclone  system.  Restricted  by  swath  width, 
the  SSM/I  imagery  shows  the  comma  tail  and  NE  area  of  the  comma  head,  but  not  the 
cyclme  center. 

Table  IV  CASE  C  SAMPLE  STATISTICS 


Box 

Rainrate 

Mean 

StdDev. 

Kurtosis 

Cl 

0 

185.83 

5.14 

3.90 

C2 

0 

186.76 

4.86 

2.78 

Mean  C 

186.30 

5.00 

3.34 

Rl 

Lt 

194.97 

2.81 

2.75 

R2 

U 

186.87 

3.46 

2.66 

R3 

Lt/Mod 

197.14 

3.15 

3.11 

R4 

Hvy 

186.45 

5.13 

3.95 

R5 

Hvy 

192.21 

3.95 

1.97 

Mean  R 

191.53 

3.70 

2.89 

Distribution  histograms  are  depicted  by  Figure  12,  and  sample  statistics  by  Table 
rv.  As  in  Case  A,  mean  IR  value  is  the  parameter  which  most  stnxigly  discriminates 
cizTus  from  rain  samples.  Cirtus  sanq>les  exhibit  a  mean  IR  value  of  186.30,  conq)ared 
to  a  value  of  191.53  attributed  to  rain  samples.  While  distinguishable,  this  difference 
is  not  as  significant  as  that  shown  in  Case  A.  The  histograms  show  a  strong  distribution 
similarity  between  the  two  cirrus  boxes.  And  while  the  distributicxis  for  Rl,  R3,  and 
R5  are  similar,  there  is  no  clear  grouping  of  values  for  light,  moderate,  or  heavy  rain. 
Standard  deviaticm  values  are  generally  less  for  rain  samples  than  cirrus  samples,  and 
again,  kuitosis  values  show  no  ccxisistent  differences. 


D.  OVERALL  RESULTS 


Cases  A,  B,  and  C  documented  vaiiadons  between  non-raining  and  raining  cloud 
areas  of  several  cyclones.  Tlie  cloud  boxes  describe  the  distribution  of  IR  values  within 
each  area  and  the  variables  mean,  standard  deviation,  and  kurtosis. 

In  general,  mean  IR  count  proved  to  be  the  strongest  delimiter  of  rain  from  cirrus. 
In  Cases  A  and  C,  rain  box  means  were  notably  higher  than  cirrus  box  means.  This  was 
not  evident  in  Case  B,  however,  where  cirrus  means  were  slightly  higher  than  rain 
means.  Standard  deviation  also  appeared  to  have  some  value  in  discriminating  rain  from 
cirrus  boxes.  Overall,  light/moderate  rain  exhibited  the  lowest  values,  citrus  the 
intermediate  values,  and  heavy  convective  rain  the  highest  values  of  standard  deviaticm. 
These  findings  are  somewhat  in  accord  with  those  of  Adler  and  Negri  (1988).  In 
discerning  cirrus  areas  from  thunderstorm  (strong  convection)  areas,  Adler  and  Negri 
attributed  warmer  cloud  top  tenqwratures  and  lower  standard  deviaticxi  values  to  cirrus 
areas.  Because  no  description  of  neighboring  li^t/moderate  rain  areas  was  given,  it  is 
unclear  if  discrimination  between  citrus  and  non-ctmvective  rain  is  possible  with  this 
method.  Adler  and  Negri’s  work  was  based  on  tropical  convective  systems,  whereas  the 
ERICA  storms  were  mid  latitude  cyclones. 

Kurtosis  values  were  examined  as  a  means  to  describe  the  peakedness  of  the 
distributirai  histograms.  This  parameter,  however,  demtxistrated  no  consistent  pattern  in 
separating  cirrus  from  rain. 
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Synoptically,  a  certain  precipitation  pattem  is  evident  from  the  SSM/I  precipitation 
analyses.  Heaviest  rain  areas,  associated  with  strcmg  cmvecdcm,  lie  near  the  cyclreie 
center,  and  are  also  evident  along  frontal  bands.  These  areas  are  usually  ringed  by  areas 
of  moderate,  then  light  rainfall.  From  the  analyses  above,  the  light^noderate  rainfall  can 
be  reasonably  identified  in  the  IR  by  high  mean  and  low  standard 
deviation.  Heavy  ccaivective  rainfall  is  not  so  readily  identified  in  the  IR.  However, 
areas  central  to  die  cycltme  ringed  by  light/moderate  rain  areas  which  exhibit  "ragged” 
IR  values  (lower  mean,  high  standard  deviation)  can  realistically  be  presumed  to  be 
convective  rain.  Cirrus  cover,  then,  appears  to  be  the  limiting  factor  in  using  IR  data 
to  identify  rain  areas.  Less  accuracy  can  be  eiqiected  for  IR  prediction  schemes  qiplied 
to  cases  with  widespread  cirrus  blowoff.  Cirrus  identification  could  be  achieved  by  the 
incorporation  of  data  from  VIS  (Lovejc^  and  Austin  1979a)  or  split-window  IR  channels 
(Neu  1990)  into  the  scheme. 

The  analyses  above  were  based  on  a  limited  number  (tf  hand-selected  cloud  boxes. 
While  the  results  suggest  diat  die  IR  value  mean  and  standard  deviation  may  be  used 
to  discriminate  rain  from  no  rain  areas,  the  number  and  selective  dioice  of  sample  cloud 
boxes  do  not  yield  statistically  significant  results.  The  following  chipter  discusses  the 
logical  extension  of  diis  analysis,  where  a  large  number  of  smaller  cloud  boxes, 
systematically  diosen  from  the  satellite  imagery,  is  analyzed  using  discriminant  analysis 
techniques. 
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y.  DISCRIMINANT  ANALYSIS  APPROACH 


Ibe  pieliminaiy  analyses  of  the  cloud  boxes  in  Chapter  IV  indicated  that  IR  mean 
and  standard  deviation  could  discriminate  rain  firom  no-rain  areas.  A  discriminant 
analysis  was  performed  to  statistically  determine  if  these  variables  could  be  used  over 
the  entire  IR  image  to  classify  precipitation. 

A.  DISCRIMINANT  ANALYSIS  THEORY 

Discriminant  analysis  is  a  statistical  procedure  for  identifying  the  boundaries 
between  groups  in  terms  of  the  variable  characteristics  that  disringuish  (me  groiq>  from 
another.  The  procedure  is  used  to  classify  events  by  finding  the  combinaticm  of 
variables  that  best  predicts  the  category  or  group  to  which  a  case  belongs.  Fcjr  this 
analysis,  events  (10  x  10  pixel  IR  cloud  areas)  will  be  classified  into  categories  (ram  or 
no-rain)  on  the  basis  of  three  variables  (IR  mean,  standard  deviation,  and  kunosis). 

The  siiiq)lest  and  most  commtxily  used  method  is  Fisher’s  linear  discriminant 
analysis  (Fisher  1936).  This  method  finds  the  coefficients  a,,  aj,  and  a,  so  that  the  linear 
discriminant  scores, 

D  =  +  32^2  ^3-^3 

for  each  group  are  maximally  separated.  For  this  analysis,  the  variables  represented  by 
Xj,  Xj,  and  X,  are  mean,  standard  deviation,  and  kurtosis.  Because  the  populaticm  is 


parthioned  into  only  two  gFoiq>s  (rain  and  no-rain),  a  single  discriminant  function  is 
sufficient  for  classificatitm. 

It  is  possible  to  adjust  the  distance  criteiicm  to  account  fm  prior  informatitxi  about 
the  likelihood  of  an  event  (prior  piobabiliQr)  and  for  unequal  misclassificatitni  costs.  If 
a  particular  misclassification  error  is  especially  undesiieable  (eg.  over-prediction  vs. 
under-prediction  of  rain  area),  dien  a  hi^r  penalty  for  that  error  would  be  incorporated 
into  the  discriminant  fimcticMi.  In  order  to  compare  die  results  to  others,  the 
discriminant  functions  in  this  study  are  consulted  assuming  uniform  prior  probabilities 
and  equal  misclassification  costs.  That  is,  an  area  has  an  equal  probability  of  being 
classified  as  rain  or  no-rain,  and  misclassification  in  either  direction  carries  the  same 
penalty. 

Discriminant  functions  are  determined  firom  a  data  set  termed  "development  data.” 
Cross-validation  is  a  method  of  testing  the  discriminant  (or  classification)  function  on 
an  independent  data  set,  termed  "validation  data." 

B.  PROCEDURE 

For  each  case  (A,  B,  and  C),  remapped  SSMA  and  IR  imagery  was  divided  into 
10  X  10  pixel  boxes.  The  NFS  IDEA  Lab  was  used  to  display  the  imagery  and  select 
a  data  set  of  10  x  10  boxes  which  meet  all  the  following  criteria: 

1.  Area  is  oceanic. 

2.  SSMA  analysis  yields  either  no-rain  (0  tain  pixels)  or  rain  (at  least  70%  raining 
pixels).  Thus,  rain  border  areas  are  eliminated. 


3.  All  GOES  IR  pixels  within  a  box  describe  mid  to  high  cloud  tc^  temperatures  (IR 
count  at  least  153,  253.5  K  or  colder,  after  Negri  and  Adler  1988). 

A  data  sample  set  of  166  boxes  was  obtained  for  Case  A,  124  boxes  for  Case  B,  and 

176  for  Case  C.  Con^utatiixial  efficiency  is  increased  by  restricting  the  analysis  to 

areas  consisting  of  mid  to  high  clouds,  where  a  high  probability  of  rain  exists.  Little 

SSM/I  rain  was  associated  with  cloud  t(^  tenq)eratures  warmer  than  253  K  for  these 

ERICA  oceanic  storms,  where  areas  of  light  (1-2  mm/h)  post-ftontal  and  stratifonn  rain 

were  sparse.  The  exclusicm  of  clear  sky  and  low  cloud  areas,  ^ere  rain/no-rain 

delineation  is  inherently  single,  does  reduce  the  statistical  success  of  the  scheme. 

For  each  sanq>le  box,  the  SSM/I-<tetermined  rain^io-rain  category  was  recorded 

for  use  as  ground  tmth.  IR  values  were  evaluated,  and  the  mean,  standard  deviation  and 

kunosis  determined  for  each  box.  Table  V  presents  a  synopsis  of  the  data  used  in  the 

discruninant  analysis  procedure.  Mean  values  of  each  of  the  three  variables  are  shown 

for  the  rain  and  no-rain  categories.  In  all  three  cases,  little  difference  is  seen  in  standard 

deviation  and  kuttosis  values.  That  is,  the  standard  deviatitm  for  each  of  the  two 

variables  exceeds  the  difference  betweoi  the  actual  standard  deviation  and  kunosis 

means  for  the  rain  and  no-rain  categories.  Values  of  mean  show  the  greatest  variation 

between  rain  and  no-rain  samples,  indicating  that  the  IR  tenq)erature  itself  may  be  the 

strongest  variable  for  classification  purposes. 

One  way  to  visualize  the  distribution  or  separation  of  the  rain/no-  rain  categories 

in  terms  of  tte  discriminating  variables  is  with  a  scatterplot.  Figure  13(a)  presents  such 
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Table  V  CLASSIFICATION  VARIABLES.  Mean  values  for  each  of  the  rainAio  rain 
classification  variables  are  indicated. 


Case 

SSM/I 

Category 

No.  of 
Sandies 

Mean 

Std. 

Deviation 

Kurtosis 

A 

Rain 

116 

194.82 

3.40 

3.46 

No  Rain 

50 

185.32 

3.15 

3.29 

B 

Rain 

77 

188.88 

2.15 

329 

No  Rain 

47 

189.57 

2.43 

3.51 

C 

Rain 

88 

192.13 

3.35 

3.16 

No  Rain 

88 

184.84 

3.85 

3.60 

a  plot,  illustrating  Case  A’s  rainAio-rain  distribution  as  a  function  of  all  diree  variables. 
"1"  and  "2"  represent  no-iain  and  rain  categories,  respectively.  The  plot  suggests  the 
separation  of  the  two  categories,  primarily  altmg  the  axis  given  by  the  IR  mean.  Figure 
13(b)  is  a  two  dimensional  plot  which  shows  the  separation  of  die  rain/no-rain  categories 
as  a  fimaion  of  two  variables.  Again,  IR  mean  is  the  strongest  discriminating  variable. 
However,  this  plot  reveals  a  significant  role  of  standard  deviation  in  the  separation  of 
rain/no-rain,  particularly  where  IR  mean  values  range  from  180  to  194  (238-224  K).  In 
this  range,  rain  areas  exhibit  higher  standard  deviation  values  than  no-rain  areas.  A 
similar  observation  was  made  by  Adler  aial  Negri  (1988),  who  found  that  at  intermediate 
temperatures  (235-215  K),  thunderstorm  areas  had  a  titter  gradient  around  their 
ten^ierature  minima  than  did  citrus  areas.  A  measure  of  standard  deviatimi,  this  gradient 
was  termed  the  "slqie  parameter"  by  Negri  aiKl  Adler. 
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I  OVVfATlflN 

Fig.  13  Scatteiplots  showing  distribution  of  Case  A  rain/no-rain  areas  as  functions  of 
a)  IR  mean,  standard  deviation  and  kurtosisj  b)  IR  mean  and  standard  deviation. 

"1"  represents  no-rain,  "2"  represents  rain. 
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While  the  scatterplots  graphically  indicate  separadcxi  of  the  rain/no-rain  categories, 
die  role  of  discriminant  analysis  is  to  quantify  that  separation  in  terms  of  the  three 
variables.  Developmoit  and  validation  data  sets  were  prepared  in  order  to  determine 
and  test  the  discriminant  functions.  One  fourdi  of  the  samples  fnun  each  data  set  was 
randomly  withheld  for  use  as  validation  data,  while  the  lemaining  three  fourths 
constituted  the  development  data.  Using  Statgnqihics  4.0  PC  software,  linear 
disciiminam  analysis  was  performed  on  each  case’s  development  data.  SSM/I  rainMo- 
rain  category  was  die  "classification  factor,"  and  IR  value  mean,  standard  deviation  and 
kurtosis  crmstituted  the  "classificatirm  vaiiables.”  Uniform  prior  probabilities  were 
assumed.  The  analyses  determined  a  discriminant  fimction  for  each  case,  classifying  die 
development  data  accordingly.  Table  VI  illustrates  the  success  of  diis  classification, 
showing  percentages  of  correctly  classified  categories.  Cross-validation  was  performed 
by  Inlying  the  disoiminaiit  functions  to  die  validation  data  sets,  and  events  were 
classified  with  die  success  rates  noted  in  Table  VI. 


C.  CLASSIFICATION  RESULTS 
1.  Rain  /  No-Rain  Classification 

As  was  evident  in  the  previous  chspter’s  cloud  box  study  and  the  scatterplots 
shown  in  Figure  13,  Case  A  shows  reasonably  clear  separation  between  rain  and  no-rain 
samptes.  Rain  boxes  were  conectly  identified  78%  of  die  time.  This  equates  to  POD 
and  FAR  scores  (Tsonis  and  Isaac  1985)  of  0.78  and  0.09,  respectively  (a  perfect 
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Table  VI  LINEAR  DISCRIMINANT  ANALYSIS  RESULTS.  Results  indicate 
percentages  of  categories  correctly  identified  by  the  discriminant  function. 


Case 

Category 

Development  Data 
(%  Correct) 

Validation  Data 
(%  Correct) 

Rain 

79.54 

78.57 

A 

No  Rain 

81.58 

83.33 

B 

Rain 

50.85 

50.00 

No  Rain 

70.59 

53.84 

Rain 

73.24 

58.82 

C 

No  Rain 

69.23 

56.52 

— 

scheme  yields  POD  =  1  and  FAR  s  0).  TlMie  is  little  difference  between  the  scores 
obtained  from  the  development  and  validaticm  data,  indicating  that  the  discriminant 
function  is  valid  fw  independent  data.  Operatitmally,  this  suggests  that  a  classification 
function  determined  for  coincident  SSM/I  and  GOES  satellite  images  is  applicable  to 
subsequent  GOES  images. 

Scores  for  Case  B  indicate  that  the  discriminant  function  has  little  skUl  in 
classifying  rain  samples.  Success  rates  near  50%  are  no  better  than  random  choices. 
Scores  for  classification  of  no-rain  san^les  are  reasonable  for  development  data,  but 
decrease  to  near-random  for  validation  data.  The  previous  chapter’s  cloud  box  study 
revealed  the  mean  IR  value  of  the  cirrus  boxes  to  be  slightly  hi^r  than  that  of  the  rain 
boxes.  This  observation  is  confirmed  in  this  more  encompassing  analysis  (Table  V). 
Considering  the  relatively  large  variance  about  the  mean  for  the  variables  IR  mean, 
standard  deviation  and  kurtosis,  little  difference  is  seen  between  the  rain  and  no-rain 
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values  for  any  of  the  three  classification  variables.  This  suggests  a  low  success  rate  for 
any  discriminant  function  applied  to  this  case. 

Case  C  scores  show  leascmable  skill  in  classification  of  development  rain  and  no¬ 
rain  data  samples.  Rain  classification  scores  translate  to  POD  and  FAR  scores  of  0.73 
and  0.30,  respectively.  However,  skill  scores  decrease  significantly  when  the  validation 
data  is  used,  indicating  that  the  classification  scheme  has  less  validity  beycxid  the 
coincidmt  SSM/I  and  GOES  data  set. 

For  diis  analysis,  die  three  classification  variables  mean,  standard  deviatitxi,  and 
kurtosis  were  incorporated  into  the  discriminant  functions.  Because  the  value  of  kurtosis 
as  a  classification  factor  was  in  question,  discriminant  fimctitms  were  then  determined 
using  combinations  of  two  of  the  three  variables  listed  (discriminant  analysis  requites 
at  least  two  variables).  Classification  results  from  these  various  functions  indicate  very 
limited  value  of  kurtosis  in  rain/no-rain  discrimination.  Confirming  the  implications  of 
Table  V,  IR  mean  is,  by  far,  the  strongest  classification  variable.  Standard  deviation 
also  is  of  value,  but  to  a  lesser  extent.  Similar  observatitxis  were  made  by  O’Sullivan 
et  al.  (1990),  who  tested  up  to  16  first  and  second  order  image  statistics  as 
discriminating  variables  far  precipitation  estimation.  They  found  their  best  results  when 
using  a  single  model  incoiporating  only  the  mean  and  standard  deviatim.  For 
operatioiuil  efficiency,  then,  discriminant  analysis  for  rain^o-rain  classification  should 
be  performed  using  only  IR  mean  and  standard  deviation.  The  dominant  role  of  the  IR 
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mean  cloud  top  temperature  in  rainAio-rain  classification  indicates  that  an  even  sinq}ler 
method  using  only  IR  count,  may  yield  similar  scores.  Such  a  method  is  er^loied  in 
Charter  VI. 

2.  Further  Division  of  Rain  Categories 

The  classificatitxi  results  shown  in  Table  VI  indicate  that  discriminant  analysis  can 
be  used  to  classify  rain  and  no-rain  events,  with  resultant  skill  levels  dependent  on  the 
case.  Chapter  FV’s  cloud  study  indicated,  for  Case  A,  that  categories  of  rain  intensity 
mi^t  also  be  identified.  Several  authors  have  attempted,  with  varying  success,  to 
erqrand  their  rairVno-rain  delineation  schemes  to  classify  rain  intensity  categories.  Negri 
and  Adler  (1987a)  found  that  useful,  accurate  rainfall  estimates  beyond  ra^r/ao-rain 
discriminatitHi  were  unlikely  with  their  IR  technique.  However,  O’Sullivan  et  al.  (1990) 
found  moderate  success  in  classifying  U^t  and  moderate/heavy  rainfall  with  an  IRA^S 
scheme.  Most  of  die  studies  worked  with  over-land  precipitation,  using  radar  as  ground 
truth.  Here,  the  possibility  of  rain  intenshy  classification  for  oceanic  areas  using 
microwave  ground  troth  is  erqilored. 

Data  san^les  for  each  case  were  analyzed  by  the  SSM/I  exponential  algorithm  to 
be  either  no-rain  (<1  nun/h),  light  (1-2  mm/h),  moderate  (2-4  mm/h),  or  heavy  rain  (>4 
mrn/h).  Again  using  the  three  IR  variables  with  uniform  prior  probabilities  and  equal 
misclassification  costs,  discriminant  functions  were  determined.  The  classification 
results,  averaged  for  Cases  A,  B,  and  C,  ate  presented  in  Table  Vn. 


45 


Table  VH  RAIN  INTENSITY  CLASSIHCATION  RESULTS.  Results  indicate 
averaged  (Cases  A,  B  and  C)  percentages  of  rain  categories  identified  by  the 
discriminant  functims.  Shaded  boxes  are  categories  correctly  classified. 


IR  Predicted 

No  Rain 

Light 

Moderate 

Heavy 

SSMA 

Observed 

No  Rain 

15.8 

16.8 

16.3 

light 

19.9 

174 

334 

29.7 

Moderate 

11.4 

20.8 

34.6 

Heavy 

14.6 

12.2 

25.4 

47,8 

The  effect  of  further  dividing  the  rain  categories  is  to  significantly  reduce  the  skill 
scenes  for  all  categories.  While  no-rain  identificatiem  is  achieved  with  leascmable  (but 
reduced)  skill  for  Cases  A  and  C,  8S%  of  B’s  nonraining  events  ate  misclassified 
as  rain.  Table  VII’s  shaded  boxes  show  percent  correct  classificaticm  of  rain  intensity 
categories,  wbldi  ranges  frenn  17.1  to  51.0.  The  no-rain  and  heavy  rain  categenies  are 
the  most  successfully  classified,  while  light  and  moderate  tain  ate  mtne  often  than  not 
misclassified.  Results  of  this  analysis  indicate  that  fiirdier  discrimination  beytmd 
rainAio-rain  categories  is  not  feasible  with  a  single  IR  channel  discriminant  analysis 
scheme. 
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VI.  OPTIMAL  THRESHOLD  APPROACH 

Chapter  V  showed  that  discriminant  analysis  could  be  used  with  some  success  to 
delineate  rain  from  no-rain  areas.  The  primary  discriminators  were  IR  mean  and 
standard  deviation,  although  most  of  the  separation  was  accounted  for  by  IR  mean. 
These  results  suggest  that  a  more  operatimially  efficient  scheme  utilizing  an  optimal  IR 
threshold  value  may  yield  similar  rainAio-rain  results.  Tscmis  (1988)  found  that  a  single 
VIS  or  IR  thresholding  scheme  was  quite  adequate  in  delineating  rainfall  from  satellite 
imageiy.  Compared  to  more  coiiq)licated  schemes,  little  accuracy  was  lost,  and  was 
more  dian  conq)ensated  frn  in  increased  flexibility,  speed  and  ecmiomy.  The  objective 
of  this  qiproach  is  to  determine  an  qrtimal  IR  direshold  value  by  optimizing  a  set  of 
statistical  parameters. 

A.  PROCEDURE 

The  512  X  512  pixel  arrays  of  the  rem^>ped  SSMA  and  IR  imagery  were  scanned 
widi  a  FORTRAN  program  on  die  NFS  IDEA  Lab.  For  each  oceanic,  mid/hi^  cloud 
pixel,  the  rainrate  (derived  from  the  SSM/I  eiqionaitial  rainrate  algorithm)  and 
coincident  IR  value  were  recorded  in  a  new  array.  As  with  the  distriminant  analysis 
tqiproach  (Chapter  V),  analysis  is  restricted  to  areas  containing  mid/high  clouds,  defined 
by  an  IR  value  of  153  (253.5  K)  or  coltter  (after  Negri  and  Adler  1987b)  to  increase 
computational  efficiency  and  to  focus  on  the  overcast  rain/no-rain  problem. 
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An  IR  threshold  value  was  defined  such  that  any  IR  value  equal  to  or  colder  than 
the  threshold  value  was  assumed  to  be  rain.  Ihieshold  values  were  chosen  iteratively, 
begining  with  153  and  panning  the  full  range  of  IR  values  obtained  (iq)  to  210).  All 
evaluatitHi  statistics  were  calculated  for  each  IR  threshold.  The  SSM/I  threshold 
remained  constant  -  any  value  equal  to  or  greater  than  1  nun/h  was  defined  as  rain, 
anything  less  as  no-rain. 

Given  the  IR  and  SSM/I  duesholds,  all  pixels  were  assigned  to  one  of  die  four 
boxes  in  the  precipitation  contingency  table.  Table  Vm  (following  the  classifications 
defined  by  Lovejoy  and  Austin,  1976).  SSM/I  classifications  are  cmsideied  to  be 
"ground  tiudi."  Thus,  die  IR  classification’s  c<»rectness  is  judged  by  its  agreement  widi 
die  SSM/I  analysis. 


Table  vm  PRECIPITATION  CONTINGENCY  TABLE  (after  Lovejoy  and  Austin 
1976) 


SSM/I 

Classification 


IR  Prediction 

Rain 

No  Rain 

Rain 

HIT 

MISS 

No  Rain 

FALSE 

DRY 

ALARM 

The  four  IR  classificadcais  are: 

1.  Hit  -  ctxnectly  classified  as  rain 

2.  Miss  -  incorrectly  classified  as  no-rain 
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3.  False  Alarm  -  incorrectly  classified  as  rain 

4.  Dry  -  correctly  classified  as  no-rain 


Following  Donaldson  et  al.  (1975)  and  Tsonis  and  Isaac  (1985),  several  measures 
of  success  or  error  were  calculated  from  this  contingency  table  (see  Appendix  A  for 
equations).  Briefly  defined,  those  measures  are: 

1.  Probability  of  Detection  (POD)  -  gives  ability  of  scheme  to  "find"  the  rain 

2.  False  Alarm  Ratio  (FAR)  -  measures  die  proportion  of  incorrect  rain  predictions 

3.  Critical  Success  Index  (CSI)  -  compromise  score  to  balance  the  need  for  maximal 
Hits  against  disadvantages  of  excess  False  Alarms 

4.  Percent  Error  (ERR)  -  measures  the  error  in  rain  area  delineation  over  the  total 
area  analyzed 

5.  Areal  Error  (AREA)  -  measures  the  percent  difference  between  observed  (SSM/I 
classified)  and  IR  predicted  rain  areas 

B.  EVALUATION 

The  optimal  IR  threshold  is  that  value  which  yields  the  optimal  combinatim  of  the 
success  measures  described.  A  perfect  rain  delineation  sdieme  would  give  POD  =  1, 
FAR  =  0,  CSI  =  1,  ERR  =  0,  and  AREA  =  0.  None  of  these  statistics  can  be  used 
alone,  however,  as  none  is  necessarily  more  representative  of  the  scheme’s  success  than 
any  other.  Rather,  each  statistic  gives  additional  information  about  the  effectiveness  of 
the  rain  delinearimi  scheme. 

Fot  instance,  a  threshold  could  create  a  rain  area  five  times  its  actual  size,  and  still 
give  a  POD  of  one.  To  be  meaningful,  a  high  POD  should  be  accompanied  by  a  low 
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FAR.  CSI  takes  this  into  account  somewhat,  by  combining  the  POD  and  FAR  scores 
into  a  single  con^romise  score.  However,  the  relative  costs  of  Miss  (rain  under¬ 
predicted)  versus  False  Alarm  (rain  over-predicted)  errors  may  vary  for  each  operational 
user,  and  should  be  crmsidered  in  the  wei^ting  of  terms  in  the  CSI  calculation.  For 
this  stwly,  CSI  is  calculated  assuming  equal  misclassification  costs  (Le.  Miss  and  False 
Alarm  enors  cany  die  same  penalty).  Because  ERR  represents  the  error  in  rain  area 
delineaticm  with  respect  to  the  entire  area  analyzed,  a  good  (low)  ERR  score  can  be 
obtained  even  with  porn*  POD  and  FAR  scores,  if  the  prec^itation  area  is  small.  And, 
while  a  low  AREA  score  means  that  the  observed  rain  area  nearly  equals  the  predicted 
area  in  size,  the  scoring  does  not  mean  that  the  two  areas  are  colocated.  Because  there 
is  no  one  piefened  score,  all  of  the  statistics  should  be  considered  in  the  development 
of  a  scheme,  with  enqihasis  placed  on  those  statistics  whidi  suit  die  needs  of  the 
particular  user. 

Ideally,  the  optimal  IR  direshold  would  be  that  i^ch  yielded  minimum  values  of 
ERR  and  AREA,  and  maximum  values  of  CSI.  Setting  a  critical  value  of  POD  would 
indicate  the  minitnum  level  of  success  acceptable  in  actually  "finding"  the  rain  areas. 
The  following  sectirm  describes  how  the  optimal  thrediold  scheme  fared  with  Cases  A, 

B,  and  C. 

C.  RESULTS 

Figure  14  illustrates  how  the  evaluation  statistics  POD,  FAR,  C!SI,  ERR  and 
AREA  varied  as  a  function  of  IR  threshold  value  for  the  three  cases  studied.  As 
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USE  A  USE  B 


USE  C 


• 

POO 

• 

FAR 

ca 

X 

ERR 

V 

AREA 

Fig.  14  Evaluation  statistics  POD,  FAR,  CSI,  ERR  and  AREA  as  functions  of  IR  value 
for  Cases  A,  B,  and  C. 


expected,  POD  and  FAR  scores  decreased  widi  increasingly  colder  IR  threshold  values 
(except  in  Case  B,  where  FAR  scores  were  nearly  constant).  It  was  anticipated  that,  by 
combining  the  POD  and  FAR  scores  into  a  compromise  CSI  score,  a  min/max  pattern 
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would  emeige  which  allowed  detennination  of  the  optimal  threshold  detenninatitxi  at 
the  CSI  maximum.  Unfortunately,  such  a  pattern  was  not  evident  in  Cases  A  and  B. 
Instead,  CSI  scores  showed  a  wavering  decreasing  trend  widi  colder  IR  threshold  values. 
Slight  relative  mins  and  maxes  were  tqjparent,  but  scores  remained  neariy  constant 
below  IR  counts  of  195  (Case  A)  and  190  (Case  B).  C!ase  C,  however,  did  exhibit  a 
modest  min/max  pattern.  Because  the  CSI  score  yielded  une^ctedly  limited 
infcHmation,  a  minimum  acceptable  POD  was  established.  Such  a  POD  would  not  only 
aid  in  obtaining  an  IR  direshold  value,  but  would  enable  comparison  of  the  scheme’s 
results  with  diose  of  other  techniques.  An  average  POD  of  0.62  was  obtained  from  the 
disctimmant  analysis  validati<Hi  data  sets  in  Chi^r  V.  In  accordance  with  diis  value, 
a  minimum  acceptable  POD  of  0.60  was  established  for  die  qrdmal  dueshold  analysis. 

Figure  IS  shows  the  pattern  of  die  evaluation  statistics  POD,  ERR  and  AREA  for 
the  three  cases  analyzed.  Statistics  are  plotted  against  increasingly  colder  IR  direshold 
values.  Although  one’s  eye  may  be  drawn  to  die  junction  of  the  three  curves  as  a 
choice  for  the  optimal  direshold,  the  goal  is  to  find  an  IR  value  diat  best  coincides  with 
minimums  in  die  ERR  and  AREA  curves  and  still  yields  an  acceptable  POD  score. 

Table  DC  is  presented  to  conqiare  die  statistical  results  of  die  optimal  threshold 
approadi  with  those  of  die  discriminant  analysis  qiproach. 
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Fig.  15  Evaluation  statistics  POD,  ERR  and  AREA  as  functions  of  IR  value  for  Cases 
A,  B,  and  C. 

1.  Case  A:  13/0901  December  1988 

Figure  IS  shows  clear  minimums  for  both  ERR  and  AREA  scores  for  Case  A.  The 
ERR  curve  is  relatively  flat  for  IR  values  below  181,  dips  from  IR  values  of  181  to  189, 


Table  IX  COMPARISON  OF  STATISTICAL  RESULTS.  Optimal  threshold  vs. 
average  (development  and  validatitxi  data)  discriminant  analysis. 


Optimal 

Discriminant  Analysis 

Threshold 

(Devel.) 

(VaUd.) 

.70 

.80 

.79 

.25 

.09 

.08 

.33 

.20 

.20 

.60 

.51 

50 

.50 

.25 

.40 

.48 

.42 

-48 

.62 

.73 

.59 

.44 

.28 

.50 

.32 

.29 

.42 

Case 


Statistic 


POD 

FAR 

ERR 


B 


POD 

FAR 

ERR 


POD 

FAR 

ERR 


and  then  rises  steadily  with  increasingly  colder  values.  The  min  ERR  score  of  0.32 
corresponds  to  an  IR  value  of  189  (229  K).  The  AREA  curve  exhibits  a  V-shaped 
pattern,  reaching  0.0  at  an  IR  value  of  184  (234  K).  At  diis  value,  IR  prediaed  rain 
area  is  equal  to  (but  not  necessarily  coincident  with)  SSM/I  predicted  rain  area.  For 
lower  (warmer)  IR  values,  [nedicted  rain  area  exceeds  observed  rain  area.  The  reverse 
is  true  for  IR  values  higher  (colder)  than  184. 

Because  no  me  IR  value  corresponded  to  bodi  ERR  and  AREA  mins  (189  and 
184,  respectively),  a  median  value  of  186  (232  K)  was  chosen  as  an  optinuQ  dueshold 
for  Case  A.  This  value  is  midway  between  the  ERR  and  AREA  min  locaticms  aiKl  also 
corresponds  to  a  weak  relative  max  in  CSI  (0.57),  seen  in  Figure  14.  A  POD  score  of 
0.70  is  obtained,  well  exceeding  the  POD  threshold  of  0.60.  At  this  IR  value,  ERR  and 
AREA  scores  vary  little  frcmi  their  minimums.  The  optimal  threshold  is  oiw  degree 
col^r  than  the  mean  tenqwrature  of  the  cirrus  boxes  found  in  Charter  V  (Table  V). 
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Compared  to  the  discriminant  analysis  method,  the  optimal  threshold  scheme 
yielded  less  satisfactory  results  for  Case  A.  Besides  the  obvious  differences  in  statistical 
analysis,  it  is  in^rtant  to  note  the  differences  in  sampling  technique  between  the  two 
methods.  While  die  optimal  threshold  pixels  met  die  same  oceanic,  mid/high  cloud 
criteria  as  the  discriminant  analysis  boxes,  the  averaging  procedures  smoothed  the  data 
and  allowed  for  the  elimination  of  rain  border  areas  in  the  discriminant  analysis  method. 
Additionally,  because  individual  pixels  (vs  10  x  10  pixel  boxes)  were  evaluated,  the 
optimal  threshold  san^le  sets  were  two  orders  of  magnitude  larger  than  die  discriminant 
analysis  sanqile  sets. 

2.  Case  B:  13/2301  December  1988 

The  ERR  curve  for  Case  B  is  leasoiably  flat  throu^out,  but  fluctuates  modesdy 
for  IR  values  colder  than  180.  The  muiimum  ERR  score  of  0.45  is  found  at  the  IR 
value  of  191  (227  K).  As  in  Case  A,  the  AREA  curve  is  V-sluqied,  reaching  0.0  at  an 
IR  value  of  189  (229  K).  A  reasonable  choi<»  for  the  IR  direshold,  then,  would  qipear 
to  be  the  median  value  of  190  (228  K).  However,  this  yields  a  POD  score  below  the 
minimum  acceptable  score  of  0.60. 

As  die  slopes  of  die  POD  curves  in  Figan  15  show,  higher  POD  values  are 
obtained  at  lower  (wanner)  IR  values.  Far  this  case,  die  threshold  was  moved  to 
progressively  wanner  temperatures  until  an  acceptable  POD  score  was  obtained.  An 
c^Himal  IR  threshold  value  of  186  (232  K)  was  chosen  for  C^ase  B,  giving  a  POD  level 
of  0.60.  As  in  Case  A,  the  choice  of  a  conqiromise  value  yields  little  deviation  of  ERR 
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and  AREA  scores  from  their  minimums,  suggesting  a  possible  "window"  of  optimal 
threshold  values.  Case  B  is  con^licated  by  the  abundance  of  extremly  cold  cimis 
associated  widi  die  jet  stream.  Table  V  showed  that  cirrus  sample  means  were  slightly 
colder  than  rain  sample  means,  indicating  diat  the  use  of  IR  value  to  determine  rain  area 
would  be  limited  in  this  case.  For  Case  B,  qidmal  thresholding  produces  superior 
results  to  discriminant  analysis.  Optimal  thresholding  was  the  only  scheme  able  to 
produce  an  acceptable  POD  level,  and  aUhou^  the  FAR  was  hi^r  (in  proportion  to 
the  increased  P(H>),  ERR  scores  were  held  nearly  ccmstant. 

3.  Case  C:  4^101  January  1989 

Unlike  the  previous  cases,  which  exhdiited  nearly  flat  ERR  score  curves  at  low 
(wanner)  IR  values.  Case  C’s  ERR  scores  decrease  ccmstantly  with  colder  values  until 
reaching  a  minimum  value  of  0.30  at  an  IR  value  of  194  (224  K).  The  ERR  curve  rises 
slightly  at  colder  IR  values.  The  AREA  curve  again  exhibits  a  V-shaped  pattern, 
reaching  0.0  at  an  IR  value  of  189  (229  K).  As  in  C:ase  B,  all  choices  of  intermediate 
IR  threshold  values  (between  189  and  194)  yield  POD  scores  below  0.60.  The  nearest 
IR  value  which  yields  an  acceptable  POD  score  of  0.62  is  188  (230  K).  Again,  near 
tninimum  values  of  ERR  and  AREA  are  seen  at  this  conqnomise  IR  threshold. 

Compared  to  dte  discriminant  analysis  (validation  data)  results  for  Case  C  (Table 
DQ,  die  (^itimal  threshold  scheme  produced  better  (lower)  FAR  and  ERR  scores,  while 
still  attaining  an  acceptable  POD.  In  this  case  the  divisitm  between  cirrus  and  rain  IR 
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values  is  evident  and  useful.  In  fact,  the  optimal  IR  threshold  value  of  188  is  equal  to 
the  midpoint  between  the  cimis  and  rain  sanq>le  IR  means  (184  and  192)  found  in 
CSiapter  V. 

In  summary,  the  following  steps  were  taken  to  determine  the  optimal  IR  threshold 
value  for  the  cases  analyzed: 

1.  Determine  IR  value  corresponding  to  minimum  EiUl  score. 

2.  Determine  IR  value  corresponding  to  minimum  AREA  score. 

3.  If  IR  values  are  not  the  same,  chose  intermediate  value. 

4.  Evaluate  POD  score  for  IR  value  retained  in  step  3.  If  POD  meets  or  exceeds 
pre-determined  acceptable  level,  use  this  IR  value  as  optimal  threshold.  If  POD  is 
below  acceptable  level,  move  to  wairr^r  threshold,  choose  nearest  IR  value  that 
yields  acceptable  POD. 

4.  Case  Comparisons 

hi  comparing  the  pattern  of  evaluation  statistics  in  Cases  A,  B  and  C,  several 
features  are  noticeable.  In  all  three  cases,  the  min  AREA  score  yields  a  lower  IR 
threshold  value  than  does  the  min  ERR  score.  Whereas  die  AREA  curve  exhibits  a 
consistent  V-shiqied  pattern,  the  shape  of  the  ERR  curve  varies  from  case  to  case.  POD 
scores  decrease  with  increasingly  colder  IR  threshold  values,  but  the  slope  of  the  POD 
curve  varies  with  each  case. 

In  ncMie  of  the  cases  did  a  single  IR  threshold  value  coincide  with  sufficient  POD 
and  minimums  in  both  ERR  and  AREA,  so  compromise  thresholds  were  selected.  The 
thresholds  chosen  were  within  three  degrees  Kelvin  of  the  value  correspCHiding  to  the 
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AREA  min.  Little  variation  was  seen  in  the  ERR  and  AREA  values  from  their  min 
values,  suggesting  that  an  optimal  threshold  window  exists. 

Threshold  values  of  186,  186,  and  189  were  chosen  for  Cases  A,  B,  and  C, 
respectively.  These  values  correspond  to  a  cloud  top  ten^rature  range  of  229  K  to  232 
K.  Studies  by  other  authors  have  revealed  a  variety  of  threshold  values.  Negri  et  al. 
(1984)  used  an  IR  threshold  of  228  K  to  describe  the  50%  coldest  area  (rain  threshold). 
When  using  single-value  IR  thresholding,  Negri  and  Adler  (1987b)  found  their  best 
results  with  a  value  of  240  K,  ^K^iile  Tsonis  (1988)  found  that  a  245  K  threshold  yielded 
optimal  results.  It  is  expected  that  the  value  be  case-dependent,  depending  cm  the 
location,  development  and  dynamics  of  each  rain  producing  system. 

While  the  threshold  is  valid  only  for  die  particular  system,  it  should  be  applicable 
for  several  hours  of  GOES  imagery,  (primal  threshold  values  were  applied  to 
subsequent  GOES  IR  imagery  for  the  three  cases  analyzed,  yielding  rain  patterns 
ccHisistent  with  synoptic  expectatitms.  Figures  16  through  23  in  ^pendix  B  show  the 
rain  patterns  obtained  when  the  optimal  IR  threshold  of  232  K  is  tqiplied  to  successive 
(30ES  IR  imagery  for  Case  A  through  Case  B.  The  rain  area  pattern  for  the  Case  A 
system  moves  east  until  out  of  range  of  the  GOES  imagery,  while  the  trailing  frontal 
band  and  associated  rain  is  tqiparent  throughout  the  series.  The  series  shows  the 
development  of  the  second  system  and  the  resulting  growth  of  the  rain  area. 
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D.  COMPARISON  WITH  OTHER  STUDIES 

Many  studies  have  been  conducted  to  estimate  rain  area  and  rate  with  satellite 
imagery.  Table  X  shows  a  comparison  of  several  of  these  studies  (including  the 
analyses  of  this  thesis)  and  their  resulting  success  statistics.  Techniques  varied  widely, 
and  rain  estimatitm  was  conq)uted  using  VIS,  IR,  and  combined  VIS/IR  imagery.  The 
location  of  the  regitms  analyzed  is  inq)ortant,  as  the  dynamics  and  resulting  ptec4>itation 
patterns  vary  greatly  between  midlatitude  and  subtropical  systems. 

Table  X  COMPARISON  WITH  VARIOUS  RAIN  ESTIMATION  SCHEMES 


1  Author 

Lovejoy 
&  Austin 
(1979) 

Tsonis 

&  Isaac 

(1985) 

Negri 

A  Adler 
(1987b) 

Tsonis 

(1988) 

O'Sullivan 
et  al. 

(1990) 

Pndky 

(1991) 

Frailey 

(1991) 

Technique 

Pattern 

Recog. 

Chister 

Threshold 

Threshold 

Disctim. 

Analysis 

Diacrim. 

Analysis 

’Threshold 

Region 

Montroal 

AGATE 

Ontario. 

Canada 

Southern 

Florida 

Ontario. 

Canada 

Southeast 

US 

NE  Atl. 
(ERICA) 

NE  Atl. 
(ERICA) 

Image  Size 
(10*  tan*) 

1.0 

1.0 

0.6 

1.0 

21.0 

27.6 

27.6 

No.  images 
examined 

25 

18 

83 

18 

330 

3 

3 

Ground 

Truth 

Radar 

Radar 

Radar 

Radar 

Surface 

Reposts 

SSM/I 

SSM/I 

Spectrum 

VIS/IR/Both 

Bodi 

Both 

VIS  IR 

VIS  IR 

Both 

IR  IR 
Dev  Val 

IR 

POD 

J5 

.66 

.98  .88 

.62  .60 

.81 

.68  .62 

.64 

PAR 

— 

.37 

.13  .07 

.38  .40 

— 

.21  .33 

.40 

ERR 

.13 

.20 

—  — 

.22  .30 

.20 

.30  .37 

.38 
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Hie  first  four  studies  listed  in  Table  X  each  examined  18  to  83  images.  Image  area 
size  was  qiproximately  1  x  lO’  km^  due  to  the  limitations  involved  using  radar  as 
ground  truth.  The  O’Sullivan  group  used  30  days  of  hourly  suface  data  as  ground  truth, 
which  enabled  analysis  of  330  images  of  an  area  covering  most  of  the  Southeast  US. 
For  the  studies  in  this  thesis,  only  three  images  were  studied.  However,  the  extensive 
ground  truth  coverage  yielded  by  the  SSM/I  swaths  allowed  analyses  of  images  with 
areas  larger  than  any  those  of  previous  studies.  Thus,  when  comparing  total  image  area 
analyzed,  the  two  SSM/I  studies  in  this  thesis  rank  second  behind  O’Sullivan  et  al.,  d 
are  nearly  30  times  the  area  analyzed  by  die  previous  four  studies.  Additionally,  die 
SSM/I  swaths  allows  analysis  of  a  broad  range  of  latitude  and  consequent  storm 
dynamics. 

Table  X  shows  that  rain  area  dehneaticHi  can  be  achieved  with  reasonably  similar 
statistical  results  by  a  variety  of  VIS  and  IR  schemes,  including  the  methods  used  in  this 
thesis.  The  wmrk  of  Negri  and  Adler  (1987b)  and  Tsonis  (1988)  is  most  conqiarable  to 
the  analyses  presented  in  diis  study,  in  that  thresholding  using  the  IR  spectral  band  was 
used.  Negri  and  Adler’s  method  gave,  by  the  far,  the  best  POD  and  FAR  scores  of  all 
the  schemes  presented,  but  ERR  sccxes  were  not  conqiuted.  Considering  location, 
Tsonis’  woric  in  Canada  most  nearly  corresponds  to  the  NE  Atlantic  area  ccmsidered 
here.  Tsonis’  method  yielded  results  quite  similar  to  those  obtained  in  this  smdy.  One 
important  difference  is  that  Tsonis’  IR  threshold  was  245  K  ,  where  this  study  found 
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thresholds  between  229  and  232  K.  Additionally,  Tsonis  examined  over-land  areas 
using  radar  as  ground  truth,  where  this  study  examined  oceanic  areas  using  SSM/I  as 
ground  truth. 

ConqrariscHi  of  this  study’s  discriminant  analysis  and  c^timal  thresholding  results 
with  those  from  a  variety  of  other  studies  indicates  that  oceanic  rain  delineaticm  success 
can  be  achieved  with  IR  schemes,  using  SSM/I  imagery  as  ground  truth.  This  is 
significant,  in  that  by  calibrating  GOES  and  SSM/I  imagery  to  find  an  c^timal  IR  rain 
threshold  and  updating  that  threshold  as  SSM/I  imagery  becomes  available,  large  scale, 
continuous  oceanic  rain  analyses  can  be  con^leted. 


61 


m  CONCLUSIONS  AND  RECOMMENDATIONS 


Accurate  global  precipitation  information  is  required  by  a  wide  variety  of 
disciplines,  including  military  q)plicatiQns.  The  develq>nient  of  satellite  techniques, 
particularly  rainfall  algorithms  using  the  microwave  q)ectrum,  has  addressed  this  need. 
But  the  pauciQr  of  microwave  data  limits  its  usefulness  for  craitinuous  rainfall  coverage. 
The  purpose  of  diis  study  was  to  use  houdy  GOES  IR  satellite  imagery  to  delineate 
oceanic  rainMo-rain  areas  for  three  ERICA  storms,  using  12  h  DMSP  SSM/I  rainrate 
analyses  as  ground  trudi. 

After  Implying  an  e^xmoitial  rainrate  algorithm  to  the  SSM/I  data,  both  SSM/I 
and  IR  inugety  were  renupped  to  allow  piael-by-pixel  intercrmparison.  Initial  study  of 
"cloud  box"  IR  values  and  distribution  histograms  suggested  that  rainAio-tain  areas  could 
be  delineated  using  IR  mean,  standard  deviatirai  and  kurtosis.  In  general,  rain  areas 
exhibited  colder  IR  mean  cloud  top  tenperatures  and  larger  standard  deviation.  Hie 
distribution  curves  for  cirrus  areas,  as  desoibed  by  standard  deviation  and  kurtosis, 
appeared  more  Gaussian  dian  those  for  rain  areas. 

The  three  variables  IR  mean,  standard  deviation  and  kurtosis  were  incorporated 
into  a  linear  discriminant  analysis  scheme.  The  technique  separated  rain  frcmi  noAain 
areas  within  a  mid^iigh  cloud  region,  resulting  in  an  average  POD  of  0.68  and  ERR  rate 
of  0.30  for  development  data  (0.60  and  0.37  for  validation  data).  Variations  of  the 
analysis  revealed  that  IR  mean  played  the  dominant  role  in  rain  discriminaticai.  Further 
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separation  into  rain  intensity  categories  had  very  limited  success,  suggesting  that  IR  data 
aitxie  does  not  contain  sufficient  information  to  discriminate  beyond  rain/no-rain 
categories. 

A  sin^ler  technique  was  applied  to  delineate  rain  areas  with  a  single  IR  threshold, 
determined  by  t^timizing  a  set  of  evaluation  statistics.  By  minimizing  percent 
misclassification  and  rain  area  size  errors  while  maintaining  sufficient  POD,  (^timal  IR 
thresholds  were  obtained  for  the  ERICA  storms  analyzed.  Thresholds  ranged  from  229 
to  232  K  and  yielded  an  average  POD  of  0.64  and  ERR  of  0.38.  Results  were  similar 
to  those  obtained  by  the  discriminant  analysis  q)proach  and  schemes  by  various  other 
audiOTS. 

Several  recommendatitHis  are  made  for  further  development  and  operational 
iiiq)lementati(Hi  of  these  rain  delineation  techniques.  This  study  assumed  no  prior 
probability  and  equal  misdassification  costs  in  order  to  allow  comparison  to  other 
methods.  However,  an  (^rational  user  is  likely  to  have  prior  information  <m  the 
likelihood  of  precq)itation,  as  well  as  varying  costs  associated  with  over-  or  under¬ 
prediction  of  rain.  These  factors  should  be  included  in  the  development  of  the 
discriminant  function  or,  if  thresholding  is  used,  in  the  wei^ting  of  terms  in  the  CSI 
computation.  This  tailoring  should  improve  the  POD  and  ERR  scores,  and  create  a 
scheme  better  suited  to  the  specific  user. 

Conq)arison  with  other  studies  shows  that  the  choice  of  IR  threshold  is  dependent 
on  the  locatitm  and  dynamics  of  the  storm  system,  and  should  be  defined  for  each  storm. 
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Evaluaticxi  of  the  techniques  discussed  here  over  various  oceanic  areas,  latitude  bands, 
and  storm  types  may  reveal  generalized  thresholds  to  use  as  starting  points  for  analysis. 
This  study  restricted  analysis  to  areas  containing  mid/high  clouds,  as  defined  by  a  253 
K  screening  threshold.  While  little  SSM/I  rain  was  associated  with  warmer  clouds  for 
the  cases  studied,  the  situation  will  differ  for  various  locations  and  storms.  It  is  critical 
that  the  screening  threshold  used  be  warm  enough  to  include  all  precipitation  events 
associated  witii  the  particular  analysis  area. 

The  main  factor  con^ilicating  the  schemes  used  was  tiie  limited  skill  of  IR  in 
eliminating  areas  of  cold  dmis  clouds.  This  situation  could  be  inq>roved  by  inclusioi 
of  addititmal  satellite  data  channels  into  the  scheme.  VIS  rfata  may  be  the  sinq>lest  to 
incoipotate,  but  is  limited  to  dayli^t  hours.  Neu  (1990)  successfully  identified  cirrus 
with  a  split-window  scheme,  where  a  high  brighmess  tenq)erature  difference  (BTD) 
between  AVHRR  Channels  4  and  5  was  attributed  to  die  ice  crystal  emissivity  and  water 
vq>or  ccHitent  of  cirrus  clouds.  Any  additional  data  to  be  included  must  be  coincident 
in  space  and  time,  and  would  require  image  rectification. 

Oceanic  precipitation  delineatimi  is  of  significant  importance  to  naval  t^rerations. 
Aviaticm  interests  and  ship-based  wesyron  systems  operations  are  critically  served  by  the 
knowledge  of  rain  area  location  and  intensity.  A  refined  operational  version  of  either 
precipitatitm  delineation  scheme  presented  here  could  be  incorpmated  into  the  latest 
version  of  the  Navy’s  Tactical  Environmental  Support  System  (TESS(3))  (Phegley  and 
Crosiar  1991).  Because  of  the  differmces  in  satellite  platforms  and  scan  modes,  botii 
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modes,  both  thresholding  and  discriminant  analysis  schemes  require  initial  remapping 
of  SSM/I  and  IR  imagery.  While  thresholding  is  inherently  a  simpler  operation,  the 
repetitive  computations  required  for  each  potential  threshold  increase  its  run  time. 
Discriminant  analysis  requires  more  initial  data  preparation,  but  the  discriminant 
functions  themselves  can  be  quicldy  obtained  using  the  statistical  packages  available 
with  TESS(3).  Thus,  both  methods  are  competitive  with  respect  to  computational 
efficiency  and  results.  The  utilization  of  SSM/I  imagery  to  determine  rain  area 
delineation  functions  or  thresholds  for  GOES  IR  imagery  can  significantly  enhance  the 
acquisition  of  continuous,  real-time  global  preciptation  data.- 
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APPENDIX  A.  STATISTICAL  PARAMETERS 


The  statistical  parameters  used  in  this  study  are  based  cm  the  work  of  DonaldstHi 
et  aL  (1975),  Lovejoy  and  Austin  (1979),  and  Tsonis  and  Isaac  (1987).  These 
parameters  have  beccnne  the  unofficial  standards  for  use  in  predictitm  of  rain  and  various 
odier  meteorological  phenomena.  The  parameters  incorporate  the  use  of  four  categories 
defined  by  the  precipitation  contingency  table.  Table  XI  (listed  previously  in  CTuqrter 
VI  as  Table  VII). 


Table  XI  PRECIPITATION  CONTINGENCY  TABLE  (after  Lovejoy  and  Austin 
1976) 


IR  Piedictiim 

Rain 

No  Rain 

SSM/I 

Classification 

Rain 

HIT 

MISS 

No  Rain 

FALSE  ALARM 

DRY 

Two  rain  area  definitions  are  made: 

1.  GOES  RAIN  =  HIT  +  FALSE  ALARM 

2.  SSMI  RAIN  HIT MISS 
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From  these  defmititxis,  the  statistical  parameters  used  in  this  study  are 


1.  Probability  of  Detection  (POD): 


POD  = 


HIT 

SSMI  RAIN 


2.  False  Alarm  Ratio  (FAR): 


FAR 


FALSE  ALARM 
GOES  RAIN 


3.  Critical  Success  Index  (CSl): 


CSI 


_ «rr _ 

HIT  +  MISS  +  FALSE  ALARM 


4.  Percent  Error  (ERR): 


ERR  - 


_ MISS  +  FALSE  ALARM 

HIT  +  MISS  +  FALSE  ALARM  +  DRY 


S.  Areal  Error  (AREA): 


AREA  » 


SSMI  RAIN  -  GOBS  RAIN 
SSMI  RAIN 
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APPENDIX  B.  APPLIED  OPTIMAL  IR  THRESHOLD 


Fig.  16  GOES  m  imageiy  for  13A)901  December  1988.  Black  area 
rei»esents  precipitati<»  as  detennined  by  optimal  IR  threshold  of  232  K. 


/ 


Fig.  17  As  in  Fig.  16,  except  13/1101  December  1988. 
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Fig.  18  As  in  Fig.  16,  except  13/1301  December  1988. 


Fig.  19  As  in  Fig.  16,  except  13/1601  December  1988. 


Fig.  20  As  in  Fig.  16,  except  13/1901  December  1988. 


Fig.  21  As  in  Fig.  16,  except  13/2101  December  1988. 
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